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Abstract 

We derive combinatorial identities, involving the Bernoulli and Eu- 
ler numbers, for the numbers of standard Young tableaux of certain 
skew shapes. This generalizes the classical formulas of D. Andre on 
the number of up-down permutations. The analysis uses a transfer 
operator approach extending the method of Elkies, combined with an 
identity expressing the volume of a certain polytope in terms of a 
Schur function. 



Key words: Young tableau, skew Young diagram, enumeration, up- 
down permutations, Schur functions, Markovian polytope, transfer 
operator, exactly solvable model. 

MSG 2000 subject classifications: 05E10, 05A15, 05A19, 82B23 



* Mathematical and Algorithmic Sciences, Bell Laboratories, Murray Hill, NJ, USA. 
email: yinb@research.bell-labs.com . 

'I'Einstein Institute of Mathematics, The Hebrew University, Jerusalem, Israel, email: 
romikOmath . huj i . ac . il . 



1 



1 Introduction 



1.1 Up-down permutations and the Euler, tan- 
gent and Bernoulli numbers 

An up-down permutation on n elements is a permutation a £ Sn 
satisfying 

a{l) < ct(2) > cj(3) < cj(4) > ••• . 

Up-down permutations, also known as zig-zag- or alternating permu- 
tations, were first studied in 1879 by D. Andre [21 13]. He showed that 
if An denotes the number of n-element up-down permutations, then 
the exponential generating function 

/up-down (2;) = 

n=0 

is given by 

/up-down(a:) = tan X + sec x. (1) 

In other words, tanx is the exponential g.f. of the even-indexed A^s, 
and secx is the e.g.f. of the odd- indexed A^s. This relates the se- 
quence (An) to the Euler numbers En and tangent numbers Tn, tra- 
ditionally defined by the Taylor series expansions 



sec X 



tan X 



2n 



(2n)l 



^ (2n- 1)!" 

n=l ^ ' 

In terms of these numbers, we have that 

A2n = ( — 1)"-E2n, ^2n-l = ^n- (2) 

Recall also that the tangent numbers are related to the Bernoulli 
numbers Bn, defined by the Taylor series expansion 

" BnX^ 



^ n=0 

via the relation 



n! 



)""i4"(4" - 1) 

' ^ —B2n. (3) 



2n 
2 



For an amusing appearance of Euler and tangent numbers unrelated 
to up-down permutations, see [9]. The notation En, Tn and i?„ will be 
used throughout the paper, always signifying the Euler, tangent and 
Bernoulli numbers, respectively, and An will be used throughout to 
denote the number of up-down permutations of order n, given by ([2]). 

1.2 Standard Young tableaux 

It is well-known ([H Ex. 23, p. 68], [El Ex. 7.64.a, p. 469-470, 520]), 
that up-down permutations can be thought of as a special case of a 
standard Young tableau. Recall that an integer partition is a sequence 
A = (Ai, A2, . . . , Afc), where Ai > A2 > • • • > A^ > are integers. 
We identify such a partition A with its Young diagram, which is the 
set {{i,j) G N"^ : 1 < i < k, 1 < j < Aj}, graphically depicted as a 
set of squares, (also called cells or boxes) in the plane, traditionally 
in the "English notation" whereby y-coordinate increases from top to 
bottom (similarly to matrix row indices in linear algebra). A skew 
Young diagram is the difference A \ ^ of two Young diagrams where 
H (Z X. If A \ /i is a skew Young diagram, a standard Young tableau 
(SYT) of shape A \ /i is a filling of the boxes of A \ with the integers 
1,2, . . . ,\X \ fi\ that is increasing along rows and columns. See Figure 
[T]for an example. 
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(a) (b) 

Figure 1: (a) The skew Young diagram (5, 5, 5, 3, 2)\(2, 2, 1, 1, 0). (b) A stan- 
dard Young tableau (SYT). 

Up-down permutations on n elements are in simple bijection with 
SYT's of shape 

(m -|- 1, m, m — 1, m — 2, . . . , 3, 2) \ (m — 1, m — 2, . . . , 1, 0) 
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when n = 2m is even, or 

(m, m, m — 1, m — 2, . . . , 3, 2) \ (m — 1, m — 2, . . . , 1, 0) 

when n = 2m — 1 is odd. The bijection converts such an SYT into an 
up-down permutation by reading the values starting from the bottom- 
left box and going alternately to the right and up. See Figure [2J 
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Figure 2: A standard Young tableau of shape (5, 5, 4, 3, 2, 1) \ (4, 3, 2, 1, 0, 0) 
and the associated up-down permutation. 



Our main interest will be in enumerating SYT's of shapes in a 
special family. For a skew Young diagram D = X \ fi, denote by f{D) 
the number of SYT's of shape D (this is frequently denoted by /^^^, 
but the current notation will be more convenient for our purposes). 
Recall the formula of Aitken [1] (later rediscovered by Feit [12]; see 
also [m Corollary 7.16.3, p. 344], [13, Ex. 19, p. 67, 609]) for f{D): 

/(Z)) = |A\H!det(- J——-) . (4) 

Using can become difficult when the diagrams A and fi are large 
(even when their difference is small!), as the order of the determinant 
is equal to the number of parts in A. As we shall see below, in certain 
cases one can give more concise formulas that also relate the numbers 
of SYT's of different shapes to each other, and notably to the "zig-zag" 
numbers {An)n>o- 

1.3 Standard Young tableaux in a strip 

The standard Young tableaux that we will consider will be of the 
following general shape, which we call an m-strip (diagonal) diagram. 
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Figure 3: An m-strip diagram. The head and tail rotated Young diagrams 
are read off in columns. 



The body of the diagram consists of n columns of m boxes each. 
The head and the tail are Young diagrams that are rotated and con- 
nected to the body by leaning against the sides of the body, as shown 
in the figure. We will usually think of m as fixed and n growing, which 
is why we use the term m-strip. 

Our main result. Theorem U] below, is a new formula for enumer- 
ating m-strip tableaux (that is, SYT's whose shape is an m-strip di- 
agram) in terms of the zig-zag numbers (A„)„>o. To introduce this 
formula, we start with some explicit formulas for small values of m, 
and then present the general formula that contains all these formulas 
as special cases. 
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Theorem 1 (3-strip tableaux). 



f 



n 



n 



n 



{3n-2)\Tn 
(2n- l)!22«-2' 

(3n-l)!r„ 
(2n- l)!22"-i' 

(3n)!(22"-i - l)Tn 
(2n- l)!22«-i(22« - !)■ 



J 



Theorem 2 (4-strip tableaux). 
/ 



/ 



(4n - 2)! 



rn2 



—E2n-2E2n 

((2n- 1)!)2 (2n-2)!(2n)! 



(4n)! 



E2n-2E2n+2 

((2n)!)2 ~ (2n-2)!(2n + 2)! 



Theorem 3 (5-strip tableaux). 



/ 



(5n-6)!r2_, 



VE 



((2n-3)!)224"-6(22'^-2 _ i) ' 



(5) 



(6) 



(7) 



(8) 



(9) 



The formulas in Theorems [H [21 [3] are special cases of an infinite 
family of formulas. To formulate them, we introduce some notation. 
Let An = An/nl (the volume of the n-th up-down polytope, see Section 
[2]). Let 

^ _ ^rt ^ _ (2" — l)An 

2"'"'"-'^ — 1 ' ^ 2"(2"^'^ — 1) ' 
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For nonnegative integers p, q, N, denote 



Xn{p, q) 



Lp/2J [q/2\ 

EE 

1=0 j=0 



{p-2i)\{q-2j)\ 

L9/2J 



j=0 

Lp/2J 



-.^2±l (-l)'^Af+g+2i+l 



i=0 



add] 



+ ( — 1) 2 AAr+p+q,+il[p^5 odd]) 



Lp/2J Lg/2J 

EE 

i=0 j=0 



[ — iy+3Ai^^2i+2j+l 

{p-2i)\{q-2j)\ 



Vim 



+ (-1)' A. {q-2j)\ 



^^72] 



/ 1^2 (-l)MAf+g+2»+l -| 



P+9 



+ (-1) 2 ^ 



Af+p+qr+l 1 [p,(j even] ) 



'- [q even] 



(here Ij^.] is 1 if x is true, otherwise). Then we have 

Theorem 4. Let D he an m- strip diagram as in Figure\^ Denote the 
head Young diagram by (Ai, A2, . . . , A^) and the tail Young diagram by 
(/^i) • • • ) A'fc) (where k = \m/2\). Define the associated numbers 
Li = Xi + k — i and Mi = fii + k — i, i = 1, . . . ,k. If the diagram has a 
total of n columns, then the number of SYT's of shape D is given by 



f{D) = {-lp)\D\\ det(x. 
if m is even, or by 

f{D) = {-l)(')\D\\ det(Y2n-rn+l{Li,Mj 



2n-m+liL^, Mj) ] (10) 
i,j=l,,,,,k 



(11) 



i,j=l,...,k 



if m is odd. 
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Note that Xj\f{p,q) and Yj\f{p,q) are linear combinations of the 
zig-zag numbers ^at+i, • • • , ^N+p+q+i- Thus, the theorem rep- 

resents f{D) for an m-strip diagram as a polynomial in the numbers 
An, whose complexity depends on the thickness m of the strip but 
not on the number of columns n. For example, for the diagram D in 
equation Q we have (Ai,A2) = (/Ui,/i2) = (1,0), so we get 



f{D) = -(4n)!det 
= -(4n)!det 



X2„_3(0,0) X2„_3(0,2) 
X2„_3(2,0) X2„_3(2,2) 

^2_n-2 _ jA2n-2 — ^2n 

hA2n-2 — A2n 7^211-2 — ^2n + ^2n+2 



which simplifies to give Q. By comparison, trying to use (HD to 
compute f{D) would result in a daunting-looking determinant of order 
n + 3, whose relation to the analogous determinants for the A^s is 
unclear. 

The following theorem gives a direct combinatorial meaning to 
Xi\f(p,q). The first part is a simple corollary to Theorem [H and the 
second part does not follow from Theorem |4] but can be proved using 
the same techniques - see Section [8l 

Theorem 5. For a permutation a £ Sn and 1 < i < n—1, we say that 
a has a descent at i if cr{i) > cr(i + 1). For integers n,p,q > 0, denote 
by On the number of permutations in S2n+p+q whose set of descents is 
equal to 

{1,2,3, ... ,p,p + l,p + 3, p + 5, ... ,p + 2n - 3, p + 2n - 1, 

p + 2n,p + 2n + 1 . . . ,p + 2n + q — 1}. 

Denote by j3n the number of permutations in S2n+p+q whose descent 
set is equal to 

{1,2,3, ... ,p,p + l,p + 3,p + b, ... ,p + 2n - 3,p + 2n - 1} 

(equivalently, an and /3„ count SYT's of the shapes shown in Figure 
[2 below). Then we have 

an = {2n + p + q)\X2n^iip,q), (12) 
Pn = {2n+l+p + q)\X2n{p,q). (13) 

Similarly, one can also give a combinatorial meaning to Yn{p, q) in 
terms of the number of SYT's for certain 3-strip diagrams. We leave 
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Figure 4: The shapes whose standard Young tableaux are enumerated by a. 
and /3„, respectively. 



the precise formulation of this statement to the reader, as an exercise 
in implementing the techniques of Section [8l 

In the next sections we develop the tools that will be used to 
prove the theorems above. The idea is to use transfer operators. This 
generalizes the transfer operator approach to up-down permutations 
introduced by Elkies [TO]. Another tool is a geometric-combinatorial 
identity that expresses the volume of a certain polytope in terms of 
a Schur symmetric function, and can be thought of as a continuous 
analogue of a known result on the enumeration of certain shifted Young 
tableaux. This identity. Proposition [12l is the subject of Section [71 

The understanding of m-strip tableaux that we gain using our 
analysis of the transfer operators gives more, and is perhaps more 
important, than just the proof of the formulas given above. In fact, 
more general formulas could be derived, and even more results such as 
an understanding of random m-strip tableaux of given shape. Thus, 
we have the following theorem. 

Theorem 6. The m-strip tableaux model is an exactly solvable model 
in the statistical mechanics sense (see Baxter fTJ). That is, the transfer 
operators can he explicitly diagonalized. 
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For more details, see Theorems 1 101 [TT] and comment 1 in Section O 

To conclude this introduction, we note that the m-strip tableaux 
model is related to the bead model studied by Boutillier [8] : The Gibbs 
measures he constructs seem to describe the limiting distribution of 
uniform random elements of the order polytope (see Section 4 for the 
definition) associated with an m-strip diagram. The m-strip tableaux 
model is also related to the square ice model from statistical physics 
(see fpj Chapter 8]), and our explicit diagonalization of the transfer 
operators can be thought of as a degenerate case of the so-called Bethe 
ansatz used in the solution of that model. 

1.4 Acknowledgements 

Theorem [U from which this project evolved, was first discovered and 
proved when the second-named author was visiting Microsoft Research 
in 2004, in collaboration with Henry Cohn, Assaf Naor and Yuval 
Peres. We are also grateful to George Andrews, Omer Angel, Cedric 
Boutillier, Ehud Friedgut, Ander Holroyd, Rick Kenyon, Christian 
Krattenthaler, Andrei Okounkov, Igor Pak, Andrea Sportiello, Balint 
Virag and Doron Zeilberger for helpful discussions. 



2 The transfer operator method of Elkies 



Noam Elkies [10] proposed the following approach to proving ([T]) . De- 
fine the n-th up-down polytope by 

Pn = {{xi,...,Xn) e[0,ir ■■ Xi<X2>X3<X4>...}. 

Computing vol(P„), the volume of Pn, in two ways, one first observes 
that this is simply related to the number An of up-down permutations 

by 

vol(P„) = ^. 

n! 

This is because (in probabilistic language) n independently drawn 
uniform random variables in [0, 1] will be in P„ with probability A„/n!, 
since for each up-down permutation a the probability is 1/n! that the 
random variables will have order structure a, and these events have 
measure pairwise intersections. 
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On the other hand, by computing the volume as an iterated inte- 
gral, namely 



vol(P„) = / dxi / dx2 / dx^ / dx4 . . . , 

Jo Jxi Jo Jx-i 



upon some more simple manipulation one obtains the following conve- 
nient representation in terms of linear operators on the function space 
L2[0,l]: 

voi(p„) = /r"-i(i),i\, (14) 



where 1 is the constant function 1, T : L2[0, 1] — > L2[0, 1] is the self- 
adjoint operator given by 

(r/)(x)= ^ f{y)dy, (15) 







and (•,•) is the usual scalarproduct on L2[0, 1]. The operator T is 
called the transfer operator Transfer operators are commonly used 
in combinatorics and statistical mechanics (where they are sometimes 
called transfer matrices) and in the theory of dynamical systems. In 
this case, having obtained the representation (jl4p . all that is left to 
do is to find the orthonormal basis {(j)k)^i of eigenfunctions, with 
respective eigenvalues A^, of T (note that T is a self-adjoint operator), 
since then one gets that 



An = nhol{Pn) = n\f2>^k~H^^ 



2 

k=l 



The eigenfunction problem for T leads easily to the solutions 

f- /{2k-l)TTx\ , (-1)'=-! -2 , 
0fc(x) = V2cos 1^ j, Afc = _ , A; = 1,2,3,... 

whereby one obtains, after some computations that we omit, 

_ 2"+^n! ^ (-l)(fc-i)(^-i) 

^ (2A:-l)"+i ' ^^^^ 

a formula that is equivalent to ([1]). 



^This operator, or rather its discrete version, was applied to up-down permutations by 
V. Arnold, see [5] and [14]. 
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3 Markovian poly topes 



We wish to generalize the transfer operator method to the setting of 
m-strip tableaux. For skew Young diagrams we can define their as- 
sociated order polytope and try to apply the same idea to its volume 
computation. However, there is a certain property of the polytopes as- 
sociated with up-down permutations that makes usage of the transfer 
operator method possible (after all, computing volumes of polytopes 
exactly is in general quite difficult). Borrowing from the language of 
probability theory, we call this property the Markov property. 

Definition 7. Let P cW^ be a polytope. If there exists a partition of 
the coordinate set 

{1, 2, . . . , d} = Ci U C2 U . . . U Cfe (disjoint union), 

such that for all j = 2, . . . , k — 1, any Cj-section of P, namely a set 
of the form 

P^-PDixeW^ : x\c,=x}, 
where x G M.^^ is fixed, decomposes as a cartesian product of the form 

P^ = Pf_ X Pf^, (17) 

where Pf_ C mC'ixC2x...xC,_i px_ ^ ^Cj+ixCj+2x...xC\ ^ ^^^^ 

we say that P is Markovian with respect to the coordinate filtration 
(Ci, C2, . . . , Cfc)- If P has this property, for any j = 1, 2, . . . , A; — 1 
define the j-th transfer operator Tj : L2(M'^-' ) — L2(M*^-'+i) associated 
with P by 

{Tj{f)){u)= [ f{v)l^p^,^^9}dv, 

JR^J 

where Pu,v is the section 

Pu,v = [x e^'^ ■.x\c^=v, x\Cj+i=uY 

The importance of these definitions becomes apparent in the fol- 
lowing proposition, which shows how certain volumes can be repre- 
sented as scalar products in some L2 space. 

Proposition 8. In the above notation, ifuE Mp'^,v G Mp'' , then 
voU{Pu,v) = (Pk-i o Tk-2 o ...0T20 Ti{6u),Sy'j^ ^^^^y (18) 
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Here 6u, <ire Dirac delta functions centered around (respectively) u, v 
in the respective distribution spaces, and voU is the Lebesgue measure 
of appropriate dimensionality (in this case, d— \Cj\ — \Cjj^i\). Fur- 
thermore, 



VOI(P) = (^rfc_iorfc_20...oT2oTi(1^2(KCi)),lL2(RC^fe)/^^^^C,)' (^^^ 

where 1 represents the constant function 1 in the respective L2 space. 

Proof. First, note the following trivial identity: If (ii,d2,(i3 S N and 
A : L2(M'^i) L2(M'^2),-B : ^2(1^'^'') ^ L2iW^'-') are linear operators, 
then for any functions / G L2 (^"^^ ),g £ -^2 {^'^^ ) we have 



(^Af,6^)(^Bg,6^)dx = ^Af^Bg). (20) 

Second, note that from the definition it follows that the set P?_ in 
(jl7p is, if it's not empty, also Markovian with respect to the filtration 
(Ci, . . . , Cj_i), with the same transfer operators Ti, . . . , as P. 

Now, equation (jl9p clearly follows from (jlSp by integrating over 
u G M*^! , u G M'^'-' . To prove (jlSp , we use induction together with the 
above observations. For each Xk-i G R'^'-— 1 let Pu,Xk-i,v be the section 

Pu,xk_j_,v = |x e M'' : = xic^_^ = Xk-i, x\Cj+i = 
Then 

VOl(Pn,i>) = / Vo\{Pu,Xk-i,v)dXk-l 

(Markov) 

/ ^ (Tk-2 ■ ■ .T2Ti5u,Sx^_^\(Tk^i5xi^_-^,5y\dxk-i 

/ (7fc_2 . . .T2Ti6u,Sxt^^^){5x^_:^,T^_iSy)dxk-.i 

Tk-2 ■ ■ ■ T2Ti5u, T^_i5y ^ 
Tk~iTk~2 ■ ■ ■ T2T16U, 



voU(Pj_-|)_ )l{P,^,_^,„^0}dxfc_i 



(induction) 



(byeq. 



as claimed. □ 
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4 The 3-strip 



As a first novel application of the transfer operator technique, we an- 
alyze the case of 3-strip tableaux. As in the case of up-down permuta- 
tions, the first step is to change the discrete problem of enumeration 
of tableaux to a continuous problem of the computation of a volume 
of a polytope. Given a skew Young diagram D (considered as a subset 
of N^), define its associated order polytope as 

Pd = \^x£ [0, 1]-^ : X(jj) < X(i,j,) if i < i'j < /|. 

For the same reasons as before, we have the connection between the 
discrete and continuous problems: 



vol(Pj 



D) 



m 

\D\\ ' 



(21) 



A key step in simplifying the analysis is choosing the correct co- 
ordinate filtration for the polytope. There is no unique way of doing 
this, but a judicious choice will result in a more easily diagonalizable 
transfer operator. For the case of a 3-strip, we choose the filtration 
described in Figure [5] below. 



















































c . 

J 



'j+2 



Figure 5: The coordinate filtration for the 3-strip. 



Note that in the figure only the part of the filtration corresponding 
to the body of the diagram is shown. However, for the head and the 
tail the principle of cutting the diagram along diagonal lines remains 
the same, and the filtration is constructed accordingly. 

Thus, from the figure it is clear that for the body of the diagram 
we get two transfer operators repeating periodically in alternation. 
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Denote Q, = {{u,v) G [0,1]^ : u < v}, then the two operators are 
A : L2[0, 1] -^L2{n),B: L2{n) ^ L2[0, 1] given by 

{Af){u,v)= fix)dx, {Bg){x)=j / g{u,v)dvdu. 

J u Jo J X 

Because the composition C := B o A wih repeat periodicahy, to prove 
Theorem [1] we wih need to diagonahze this operator. We compute: 

(C/)(x) = {B{Af)){x)= r [\Af){u,v)dvdu 

Jo Jx 

/ / f{y)dydvdu 

Jx J u 

f{y) / du j dv\dy 

\Jo JxVy J 

1 

^{y){x Ky)(\- x\l y)dy 



fX i-\ 

C^-x) f{y)ydy + x f{y){l-y)dy. 

Jo Jx 



Now, to find the eigenfunctions: 
Xf{x) = (C/)(x) 



(l-x) [ f{y)ydy + x [ f{y){l-y)dy, (22) 

Jo Jx 



A/'(x) = - / yf{y)dy + / f{y)dy, 

Jo Jx 

\f"{x) = -fix). 

From (j22p we get the boundary conditions /(O) = /(I) = 0. This 
gives the solutions (scaled to have L2-norm 1): 

</>fc(a;) = \/2sin(7rA;x), Afc = A; = 1,2,3,... 

Proof of Theorem [21 We prove ([7j) ; the proof of the other formulas is 
similar and is omitted. If Dn is the skew Young diagram appearing in 
([7j), then its associated order polytope is Markovian with respect to 
the coordinate filtration in Figure El One has to be careful at the ends 
of the diagram; the first and last transfer operators are easily seen to 
be, respectively, 

[Tf^rMx) = m,stf ){x) = C f{y)dy. 
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This gives, using Proposition [8] and ([2T]) . that the left-hand side of ^ 
is given by 



fiDn) = (3n)!vol(PDj = (3n)!(riast(i?Ar''Tfi,,tl,l 
= (3n)!<|c"-i(l-x),2;^ 

oo 

= (3n)!^A^-Vx,0fe)(l-x,</.,, 



fc=i 



A quick computation gives that (^x, cpkj = \/2(— l)'^ ^ /"^k, yl— x, (pk 
V2/7Tk, so 

fc=i 

(where as usual C{x) = X^^i't-"^)- Now substituting the classical 
identity 

fc=i ^ ^ 

(together with ^) gives d?!). □ 



5 The 4-strip 

While the analysis so far has been relatively straightforward, the case 
of the 4-strip is the first case where one encounters relative diffi- 
culty in diagonalizing the transfer operator, which now works on a 
2-dimensional domain. As before, we choose the coordinate filtration 
obtained by cutting the diagram along diagonal lines, as shown in the 
figure below. 

Again, we get the following two transfer operators repeating peri- 
odically in alternation. Denote as before O = {{u, v) S [0, 1]'^ : u < v}, 
then we have that A, B : L2(yt) L2{^) are given by 

{Af){x,y) = f{u,v)dvdu, 

Jo Jx 

/•V pi 

{Bg){u,v) = g{x,y)dxdy. 

J U J V 
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'J-I ^ 





























































c . 
J 



■j+2 



Figure 6: The coordinate filtration for tlie 4-strip. 



A small simplification is to note tfiat there is a certain symmetry, 
in that A and B are conjugate to each other: B = CAC, where 
C : L2{^1) L2{0,) is the reflection operator 

{Cf){x,y) = f{l-y,l-x). 

So, instead of diagonalizing the composition BA = CAC A we can 
diagonalize its simpler "square root" CA, given by 



{CAf){x,y) 



f{u, v)dv du. 



(24) 



10 Jl-y 

So we are loofcing for A, / which are solutions of 
A/(x,y)= / / 

Jo Jl-y 

Differentiating once with respect to each variable gives 



f{u, v)dv du. 



X 



dxdy 



Differentiating again w.r.t. x, y and substituting in 

d^f 1 



The boundary conditions are easily seen to be 

/(x,l) = 0, f{x,x) = 0, UO,y) = 0, 



(25) 

gives the PDE 
(26) 

(27) 
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a mixture of Dirichlet- and Neumann-type conditions on the three 
boundary sides of $7. 

Now, it may be verified that the L2-iiormahzed solutions to this 
boundary value problem are given by 

cosr^i^tik) \ 

cos(^iH^) j' 
k > j > integers, (28) 

(note that the eigenfunctions are parametrized by two integers) . While 
verification is easy, two related questions that should be addressed are: 
how these solutions can be derived rather than guessed; and how to 
prove that these solutions span all eigenspaces. We answer the first 
question and then point out how this essentially contains the answer 
to the second. The PDE ([26]) is of a very simple form that suggests 
trying to use Fourier series and the method of separation of variables. 
However, the domain is not of a shape suitable for the application 
of this method. But looking at the boundary conditions (j27|) suggests 
looking for a function on a larger domain that satisfies the symmetry 
and anti-symmetry conditions 

f{y,x) = -f{x,y), 
f{-x,y) = f{x,-y) = f{x,y), (29) 
/(x,2-y) = f(2-x,y) = -f{x,y) 

since such a function will automatically satisfy (j27p . Now, any func- 
tion satisfying ()29p is periodic in both variables with period 4, i.e., 
satisfies f{x + 4, y) = f{x, y + 4) = /(x, y), and its values everywhere 
are determined by its values on 57. Thus one gets a problem suitable 
for the application of the method of separation of variables: Expand 
/ in a Fourier series 

f{x,y)= ^ Ca,bexp (^{ax + by) 

The symmetry conditions (j29p translate to the following equations on 
the coefficients Ca^'- 



t>j,k{x,y) 



2det 



cos 



cos 



4(_l)j+fe-i 
7r2(2j-l)(2A;-l)^ 
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Ca,b = {-lr^Ca,b, Ca,b = (-l)"+'c,,b. 



In particular the last conditions imply that a, b are odd if Ca,b / 0. 
Eq. ([25]) implies the additional equation 

—XabCa,b = -i^^^Ca^b-, 

Denoting A = / tt"^ ah for some (and therefore all) a, h for which 
Ca,b 7^ 0, it is easy to verify from these relations that / is a linear 
combination of the functions cj)j^k with k > j > and \ab\ = (2j — 
l){2k — 1) (note that some eigenvalues do have multiplicity greater 
than 1, corresponding to different representations of \ab\ as products 
of distinct odd positive integers). 

It remains to answer the second question posed above, of showing 
that the system (p8]) is indeed a complete eigensystem for the operator 
CA . The answer is encoded in the previous discussion, but one has 
to argue more formally now. Let X be the subset of L2([-2,2]2) of 
functions satisfying the symmetry conditions (129p . and let Y be the 
subset of L2{0,) of functions satisfying the boundary conditions ([271) . 
Let D be the linear operator on X given by 

{Df){x,y)= [' " C f{u,v)dvdu, (30) 
Jo Jo 

manifestly a compact self-adjoint operator. 

Note that Df can be also defined by the right-hand side of (p^ 
due to the symmetry conditions imposed on elements of X. Let P : 
X — > y be defined by Pf = f\Q- Then P is clearly an isomorphism of 
Hilbert spaces, and D is conjugate to CA under P, i.e., CA = PDP~^. 
Therefore / G y is an eigenfunction of iff P~^ f is an eigenfunction 
of D. As the eigenfunctions of D form a complete orthonormal system 
in X, we have proved: 

Proposition 9. The system ()28p is a complete normalized eigensys- 
tem for the operator CA. 

Proof of Theorem [H Denote by Fn and G„ the skew Young diagrams 
appearing on the left-hand sides of ([8]), ([9]), respectively. Following 
the same reasoning as before using Proposition [8] and (j2ip . we have 
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that 

= {An-2)\(i,CAf^-\y-x),y-x), 
f{Gn) = (4n)!((C7A)"(^!_^),^!_^). 

Using these formulas and Proposition [9l after a computation one fi- 
nally arrives at ([8]), ([9]), using (123]) and another classical identity due 
to Euler, namely 

^(2A;-l)2«+i 22"+2(2n)! ' 

We leave verification of these straightforward details to the reader. 
Also note that these computations are superseded by our more general 
proof of Theorem [J] in Section [HI □ 



6 The 2/c-strip and the {2k + l)-strip 

Having analyzed the case of 4-strip diagrams, the results are now easily 
generalized to the 2fc-strip and the {2k + 1). Here are the results for 
the 2/c-strip. The coordinate filtration is again constructed by cutting 
the diagram along diagonals. This leads to a transfer operator on 
L2(r2fc), where 

Ofc = |x G [0, 1]''' : xi < X2 < . . . < Xfcj. 
The transfer operator is given by 

{S2kf){xi, ...,Xk) = 

l-Xk rl-Xk-i rl-Xk-2 rl-xi 

/ / • • • / f{yi, yk)dyk dyk-i ■ ■ ■ dyi. 

Jl—Xk Jl—Xk—i J 1—X2 

(31) 

In this representation we have already taken advantage of the sym- 
metry using the "square root" trick as in the case of the 4-strip to 
reduce two conjugate transfer operators repeating in alternation to a 
single operator. Diagonalizing S2k leads to the following boundary 
value problem: 

d''f{xi,X2,...,Xk) {-if 



dxidx2 ■ ■ ■ dxk A 



-/(I - Xfc,. . . ,1 - X2,l - Xl), 
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/ = on Xi = X2,X2 = X3, . . . = Xfc,Xfc = 1, 

= on xi = 0. 
The ideas of Section [5] can be used to prove: 

Theorem 10 (Diagonalization of the 2A:-strip transfer operator). The 

system of functions and associated eigenvalues 

0,„...,,(xi,...,x,) = 2'=/2detfcosf^^^^^V^ll 

2fc(_l)(2)+Ep0p+i) 

^ 7r'=(2ii-l)(2j2-l)...(2jfc-l)' 
Ji > J2 > • • • > jk > integers, 

is a complete orthonormal eigensystem for the operator S2k in (|3ip . 

For the (2A: + l)-strip, we have similar resuhs generahzing the anal- 
ysis of Section m In this case, we have two operators A : L2(f^A;+i) — > 
L2{^k),B : L2{^k) L2{^k+i) given by 

{A9){xi, ...,Xk) = 

rxi [■X2 I-X3 r-Xk r-l 

••■/ / 9{yi,---,yk+i)dyk+i ■■■ dyi, 

J xi J X2 Jxf^_i J Xjf 

{Bh){yi,...,yk+i) = 

rJ/2 rys ryi rVk+i 



h{xi, . . . , Xk)dxk ■ . . dxi. 

'y\ Jyi Jy-i Jyu 
The relevant operator to diagonalize is the composition AB. This 
leads to the following boundary value problem: 

Q2k^ 1 

= — /, f\ =0 

d'^xid'^X2 ■ ■ ■ d'^Xk ' \9^k 

The solution is given by the following theorem. 

Theorem 11 (Diagonalization of the (2A;+l)-strip transfer operator). 
The system of functions and associated eigenvalues 

<Pju...,jkixi,- ■ ■ ,Xk) = 2''/^ det (^sm{TTjpXg) 

^ JIJ2 ■ ■ - Jk 

ji > 02 > ■ ■ ■ > jk > integers, 
is a complete orthonormal eigensystem for the operator AB. 



l<p,q<k 
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7 A Schur function identity 



In this section, we prove an identity that wih be used in the next 
section in the proof of Theorem SI 

Let A = (Ai > A2 > . . . > Afc > 0) be a Young diagram, possibly 
with some parts being 0. Consider the head (or tail) polytope Px, 
defined by the system of linear inequalities: 

0<yi,j<l l<i<k, -{k-i)<j<Xi, 
Vij > Vi+iJ where defined, 
Vij > ViJ+i where defined, 

and for x = (xi, . . . , Xfc) in the simplex Qk, denote by -Pa(x) the section 

Pa(x) = |y G -Pa : Vk+i-i-ii-i) = Xi, i = 1, 2, . . . , fcj 
(see Figure ED- 
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Figure 7: The polytope Pa is the order polytope of the diagram (which is 
not a skew Young diagram) formed by leaning the Young diagram A against 
a triangular ("staircase") diagram, and -Pa(x) is its section where the values 
along the main diagonal are xi, . . . ,Xk- In this example A = (6, 3, 3, 1, 0). 



Obviously, the volume of Pxi^) is a polynomial function on the 
simplex il.^. More precisely: 

Proposition 12. Let Li = Xi + k — i, 1 < i < k. Ttie volume of the 
polytope -Pa(x) (of the appropriate dimensionality) is 

1 . . f L 
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Proposition [12] generalizes a well-known fact corresponding to the 
case A = (0, 0, ... , 0), see for example [6^, Lemma 1.12] and [TTl Sec- 
tion 4]. It is known to experts, though perhaps in a slightly dif- 
ferent form, and can be proved using the Karlin-McGregor theory 
of non-intersecting paths. We will give a direct proof by induction. 
Note that the expression on the right-hand side of (|32|) is equal to 

Y[i=i^i^-) ■5a(x)1^(x), where sx is the Schur symmetric function 
associated to A and ^(x) = ni<7 ( 

the Vandermonde deter- 
minant. 

Proof. We will proceed by induction on |A| + k (where | A| = Ai -|- . . . -|- 
Afc). The induction base is trivial. For the inductive step, we divide 
into two cases according to whether A^ > or Afc = 0. In the former 
case, the inductive hypothesis holds for the smaller Young diagram 

A' = (Ai-l,A2-l,...,Afc-l), 

and the volume of the polytope -Pa(x) can be represented as 

vol*[PA'(yi, • • ■,yk)]dyk dyt-i ■■■dyi (33) 

Xl JXk-l 

(this is essentiallly a transfer operator computation, since the diagram 
formed by A with its adjoining triangular part can be obtained from 
the corresponding diagram for A' by adding one diagonal). Using the 
inductive hypothesis, the integrand is antisymmetric, and therefore 
the expression in (|33p can be rewritten as 

YoU[Py{yi, • • • , yk)\dyk dyk-1 .--dyi (34) 



(similar reasoning was used in the proof of Proposition [9]), which in 
turn, again by the inductive hypothesis, is equal to 

Xl fXk / I ^ \ 

det [jJ^-rYyVi ' 1 dyk... dyi 



JO 



det{^x^) , (35) 



proving the inductive step in this case. 

The other induction step deals with the second case where A^ = 0. 
Here, we use the inductive hypothesis for the Young diagram 

A' = (Ai, . . . , Afc_i) 
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(the same diagram, but we attach to it a smaher triangle of order 
k — 1 only). The relation between the two polytopes Px (x) , -Pa' (y ) 
can be seen (again using an iterated integral which is really a transfer 
operator computation) to be 



vol, (Pa (x)) 



X2 fX3 



Xl J X\ 



vo1*(Pa' (2/2, • • • , yk))dyk ---dys dy2. 



XI 



This can be dealt with similarly to (j35p . simplifying eventually to the 
expression 



det 



V 1 



1 



1 



which is exactly the right-hand side of 
induction step). 



(since = in this 
□ 



It is worth noting that this proof, similarly to the computations in 
the previous sections, is based on cutting the diagram along diagonal 
lines and computing recursively using transfer operators. 



8 Proof of Theorems 4 and 5 



Lemma 13 (Andreief's Formula [4J). // (f^,/i) is a measure space, 
and /i, /2, • • • , A, 5i, 52) • • • ) fffc o,re real-valued functions on Q, then 



[ det (mxi) 



det gj{xi) 



dfi{xi) . . . dn{xk) 



k\ det / fi{x)gj{x)dn{x) 



Proof. 



/ det ( /i(xj) I det igj{xi)] 
Jn"' \ / i,j \ J i<i,j 



dfi{xi) . ..dfj,{xk) 



<k 
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/ Yi £(^)^(^)^•^<^(o(^^)5^(o(^^)^^^''(^l'•■ 
'*^'" (xeSfc 7T€Sk 1=1 

k 



,Xk 



a€Sk r^eSk j=l ^-^^ 



kl det / fi{x)gj{x)dn{x] 



t-i 



A 





















• 

• 

• 










'^4 




^^2 



't-l 



□ 



Figure 8: The coordinate filtration for tlie diagram D. 



Proof of Theorem^ We now compute f{D), wliere D is described in 
Theorem m for the case when m = 2fc is even. The case of odd m is 
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done similarly and is left to the reader. We choose the usual filtration 
(Ci, C2, . . . , Ct), except that the first coordinate set Ci represents the 
tail and the triangular part of the body to which it is attached, and 
similarly the last coordinate set Ct represents the head and the trian- 
gular part of the body to which it is attached, as shown in Figure [HJ 
Proposition [T5] gives us a good starting position for this computation, 
since it implies that the first and last transfer operators, Ti and Tf, 
satisfy 

{Til){xi,...,Xk) = ■ det (xf'j =:'ipx{xi,...,Xk), 

(T;1)(xi, . . . ,a:fe) = . det (xf'] =: ipf^ixi, . . . ,Xk). 

[[i=iMi\ \ / i<i,j<k 



The transfer operator for the body part is S2k defined in ()3ip . There- 
fore we get using Proposition [8] that 



Expanding this using Theorem [101 we get, in the notation of that 
theorem, 

f{D) 



\D\\ 



.is 



To compute i^if^x, 4'ji,...,jk / ' ( V'/^i 4'ji,...,jk /' Lemma [T3l 

= I ■■■ I "^^^(77) det ^\/2cos ('-(2jV - dxi . . .dx 

J '^^k \ J r,s V ^ J r,s 

= 2^1'^ det ^--^ ^ x^'- cos (|(2jr - l)^:) dx^ 
= 2^/^dei(l{L,,jr)\ , 

V / r,s 
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where we have denoted 
I{a,j) 



x"cos(|(2i-l)x)dx. 



Now, continuing (j36p . we get, again using Lemma [T3] (this time used 
with a discrete measure), that 



k / ni 2n— m+1 



d«M2E(47^J /(L.,j)/(M„,) . (37) 



■ 2(-l)-'+^ \ 2""™+^ 
^ - Vvr(2j-1), 

A simple computation, which we include in Appendix A, shows that 



p=0 

a+l 



We also verify in Appendix A that 



^7v(p,c?)=2j;(^^A_^j /(p,i)/(g,j). (39) 



^ V7r(27 - 1 

Therefore the expression written inside the determinant in (j37p is ex- 
actly X2n-m^\iJ^s-,^'U^- This proves pUj) . □ 

Sketch of proof of Theorem O Eq. (jl2p follows immediately from the 
case m = 2 of Theorem HI Eq. psp does not follow from Theorem [H 
but can be proved using the same techniques. In fact, a both formulas 
can be treated simultaneously by showing that 

X^(p,(?) = /r^(x7p!),xVg! 



where T is Elkies's transfer operator defined in (jl5p . and relating this 
quantity to a„ and /3„ using Proposition [8] and the trivial {k = 1) case 
of Proposition [T2j □ 
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9 Additional comments and questions 



We conclude with some final comments and open questions. 

1. More enumeration formulas. Our treatment of enumera- 
tion formulas that can be derived by using the explicit diagonalization 
of the transfer operators in Theorems IIOI [TT] is by no means complete 
and is meant more as an illustration of the power and generality of 
the technique. One may consider several variant formulas. For exam- 
ple, one may lean the head Young diagram against the vertical side of 
the triangle (the shape on the right-hand side of Figure H] is a simple 
example of this). This will result in enumeration formulas which are 
minor variations on the formulas of Theorem HI More generally, one 
may consider m-strip diagrams with head and tail shapes which are 
not Young diagrams, so that the overall shape is not necessarily even a 
skew Young diagram. Formula ([4]) will no longer apply, but the trans- 
fer operator technique will still enable deriving enumeration formulas 
for such "generalized tableaux" , although the use of Proposition [T2] 
would have to be replaced with more tedious manual computation. 

2. The principal eigenfunction. It is interesting to look at the 
principal eigenfunction of the transfer operators, since, for example, it 
controls the limiting behavior of uniform random points in the order 
polytope of a very long m-strip diagram (when m is fixed and n goes 
to infinity). One gets a simple product representation. For example, 
for the even case where m = 2k, the principal eigenfunction is 



By representing each of the cosines as a Chebyshev polynomial in 
cos(7rxj/2), one can transform this determinant into 



The probability density ^(x)^, which will arise as the stationary dis- 
tribution of the coordinates of a uniform point in the order polytope 
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when cutting along successive diagonals, is similar to eigenvalue den- 
sities arising in random matrix theory. One may hope to exploit this 
to derive interesting results about random m-strip tableaux. 

3. Open problem: Generating functions. It would be in- 
teresting to find formulas for the generating functions of some of the 
families of diagrams treated above. In some cases it's easy. For ex- 
ample, for the diagram in eq. d?]) the generating function can be 
computed to be 



In more complicated cases we have not found formulas for the gener- 
ating functions. 

4. Open problem: Bijective and combinatorial proofs. 

Another direction which might be interesting to pursue is to look for 
combinatorial or bijective proofs of some of our formulas, for example 
to prove Theorem [T] by directly relating 3-strip tableaux to up-down 
permutations in some combinatorial way. 

5. Extension to periodic ribbon tableaux. We restricted our 
computations to the simplest case of "periodic" Young diagrams, those 
having the slope (1, 1). Most of the results above can be carried over 
(at the cost of a sizable increase of complexity) to the case of Young 
diagrams shaped as stacks of m periodic ribbon Yound diagrams (if 
one considers our m-strip diagonal YD's as stacks of m up-down YD's). 
We plan to present these results in a subsequent publication. 
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Appendix A. Some computations 
A.l. Proof of (ESj) 

Let 9 = §(2j — 1). By repeated integration by parts, we get 
1 /-i 

I(a,j) = — I x"' cos iOx) dx 
a! 7o 

= — -x"sin(6'x) L + cos (6'x) L 

a! [a — Ij! 

- (^^"'' sin(^x) i; - j^x^-' cos{ex)\l 

L«/2J . 



A. 2. Proof of ([22D 

Rewrite as 




30 



Using this and (|38|) . the right-hand side of (|39|) is seen to be 



b/2j L9/2J 

EE 

L9/2J 

+(-1)"=*^ E 

i=o 

Lp/2J 

+(-1)^ E 



(-1) 



i+j 



{p-2i)l{q-2jy. 



2(-l)^ 



1=0 



{q-2jy. 
(p- 2ii)! 



- Vvr(2^-1) 



^ V^(2^-l) 

2(-l)'^+l \ ^"+2^+9+2 



L[p odd] 



+ (-1)^+^ 
b/2j [9/2] 



EE 



i=0 j=0 



- Vvr(2^-1) 
2(-l)^+i\ ^+^+9+2 

t Vvr(2^-1) 

(-l)'+-^'ijV+2»+2j+l 

{p - 2i)l{q - 2j)\ 



[q odd] 



2E 



[p,g odd] 



L«/2J ^ nil 



E 

b/2j 



[p odd] 



(9-2^)! 



i=0 



+ (-1) 2 +^AAr+p+5+il[p^g odd] 



□ 
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